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2 0 [Reason for Appeal] 

[Prosecution History] 
Filing of Application September 27 , 2002 

Issuance of Notice of Grounds for Rejection April 24, 2 0 07 
Filing of Argument June 25, 2 0 07 

25 Issuance of Decision of Rejection October 4, 2007 

Receipt of Decision of Rejection October 16, 20 07 

[Main Points of Decision of Rejection] 

(a) The Ground for Rejection stated in the original Decision of 
Rejection was that the present application was not patentable due 

3 0 to the regulations prescribed in Article 29, Paragraph 2 of the Patent 

Law, because it would have been easily invented by those skilled in 
the art, based on the inventions disclosed in Cited Reference 1 and 
Cited Reference 2. 

(b) The specific Ground for Rejection is that regarding Claims 1 
35 through 11, Cited Reference 1 discloses providing four sided patches 



in a reference frame and other frames, obtaining correlative 
relationships among images within the four sided patches, then 
synthesizing the reference frame and the other frames (Cited 
Invention 1) . In addition, Cited Reference 2 is directed to an 
5 automatic surveillance system, and discloses a technique by which 
image groups that constitute important scenes are extracted (Cited 
Invention 2) . 

Cited Reference 1: Y. Nakazawa, T. Komatsu, T. Saito, "Obtainment 
10 of Highly Detailed Digital Images by Frame 

Integration", Journal of ITE, Vol, 40, No. 3 , pp. 
2 99-308, The Institute of Image Information and 
Television Engineers, 1995 

15 Cited Refernece 2: Japanese Unexamined Patent Publication No. 

H10-285581 

[Reasons Why the Present Application Should be Allowed] 

2 0 (1) Description of the Invention of the Present Application 

The invention of the present application is characterized by 
the following steps being performed, as recited in the Scope of Demand 
for Patent as originally filed. The steps are: extracting a frame 
group that constitutes one or more important scenes from a video 
25 image; determining a reference frame for said important scene from 
among said frame group by a predetermined method; placing a reference 
patch comprising one or a plurality of rectangular areas on said 
reference frame; respectively placing patches which are the same as 
said reference patch, on the others of said plurality of frames; 

3 0 moving and/or deforming said patches in said other frames so that 

an image within the patch of each of said other frames approximately 
coincides with an image within said reference patch; respectively 
acquiring correspondent relationships between pixels within the 
patches of said other frames and a pixel within said reference patch 
3 5 of said reference frame, based on the patches of said other frames 



after the movement and/or deformation and on said reference patch ; 
and acquiring a synthesized frame from said plurality of frames , based 
on said correspondent relationships . 

Here, Claims 1, 5, and 10 recite "determining a frame, which 
5 is located at approximately a center, among a plurality of frames 
of said frame group, as a reference frame for an important scene; 
and Claims 2, 6, and 11 recite "determining a frame including the 
most high frequency components as a reference frame for an important 
scene" as the predetermined method for determining the reference 
10 frame. 

(2) Description of the Cited References 

(a) Cited Reference 1 

15 Cited Reference 1 is described in the present application as 

"Related Art" (Non Patent Document 1) . As the Examiner has pointed 
out, Cited Reference 1 discloses a technique of : providing four sided 
patches in a reference frame and other frames; obtaining correlative 
relationships among images within the four sided patches; then 

2 0 synthesizing the reference frame and the other frames (Cited 
Invention 1) . 

More specifically, as described in Paragraphs 00 03 and 00 04 
of the present specification, Cited Reference 1 discloses a method 
that employs one sampled frame as a reference frame, places a 

2 5 reference patch consisting of one or a plurality of rectangular areas 

on the reference frame, and respectively places patches which are 
the same as the reference patch, on the others of the sampled frames 
(page 301, right column, lines 10-14 of Cited Reference 1) . The 
patches are moved and/or deformed in the other frames so that an image 

3 0 within each patch coincides with an image within the reference patch. 

Based on the patches after the movement and/or deformation and on 
the reference patch, this method computes a correspondent 
relationship between a pixel within the patch of each of the other 
frames and a pixel within the reference patch (page 301, right column, 
35 line 15 to page 304, left column, line 10 of Cited Reference 1) . 



Interpolating calculations are administered with respect to the other 
frames and the reference frame, based on the correspondent 
relationship, and the calculation results are assigned to a total 
image having an ultimately necessary resolution (number of pixels) , 
5 thereby synthesizing the reference frame and the other frames into 
the total image (page 304, right column, lines 11-33 of Cited 
Reference 1) . 

(b) Cited Reference 2 

10 Cited Reference 2 discloses a method, in which moving bodies 

within images are detected, based on differences between an image 
within a frame and a background image thereof as well as differences 
among the image within the frame and images within adjacent frames; 
features of the detected moving bodies are calculated; and judging 

15 whether the moving bodies are detection targets, based on comparisons 
of the calculated features and features of non detection targets 
and/or detection targets, which are prepared in advance (Cited 
Invention 2, from the abstract and the like of Cited Reference 2) . 

20 (3) Comparisons between the Invention of the Present Application and 
the Cited References 

(a) Comparison between the Invention of the Present Application and 
Cited Invention 1 

25 Here, when the invention of the present application and Cited 

Invention 1 are compared, it is recognized that the two inventions 
are common in that : 

(i) "a reference patch comprising one or a plurality of rectangular 
areas is placed on a reference frame (from among a plurality of frames 

3 0 of a video image) ; patches, which are the same as said reference patch, 
are respectively placed on the others of said plurality of frames; 
said patches in said other frames are moved and/or deformed so that 
an image within the patch of each of said other frames approximately 
coincides with an image within said reference patch; correspondent 

3 5 relationships between pixels within the patches of said other frames 



and a pixel within said reference patch of said reference frame are 
acquired, based on the patches of said other frames after the movement 
and/or deformation and on said reference patch; and a synthesized 
frame is acquired from said plurality of frames, based on said 
5 correspondent relationships'' . 

However, Cited Invention 1 does not have the following features 

(ii) and (iii) , which are limitations of the invention of the present 
application. Cited Reference 1 neither suggests nor discloses these 
features . 

10 (ii) The method by which "a frame group that constitutes one or more 
important scenes are extracted from a video image" , 

(iii) The method by which a reference frame is determined from among 
the plurality of frames of the frame group that constitutes the 
important scenes. That is, "determining a frame, which is located 

15 at approximately a center, among a plurality of frames of said frame 
group, as a reference frame for an important scene" as recited in 
Claims 1, 5, and 10; and "determining a frame including the most high 
frequency components as a reference frame for an important scene" 
as recited in Claims 2, 6, and 11. 

20 

(b) Comparison between the Invention of the Present Application and 
Cited Invention 2 

Cited Reference 2 disclose detecting a surveillance target 
object from within a single frame (image) , but does not explicitly 

25 describe detection of a frame group (image group) that constitutes 
an important scene, from among a plurality of frames (images) of a 
video image. If it is interpreted that a collection of frames, in 
which the surveillance target object has been detected, is a frame 
group that constitutes an important scene, it may be recognized that 

3 0 the invention of the present application and Cited Invention 2 have 
the above feature (ii) in common. However, Cited Invention 2 does 
not have features (i) and (iii) , which are limitations of the 
invention of the present application. Cited Reference 2 neither 
suggests nor discloses these features. 



35 



(C) Comparison between the Invention of the Present Application and 
a Combination of Cited Inventions 1 and 2 

From (a) and (b) described above, a combination of Cited 
Inventions 1 and 2 lacks the feature (iii) , and all of the limitations 
5 of the invention of the present application cannot be derived. 

In addition, Cited Reference 2 is related to an automatic 
surveillance system, of which the objective is to detect surveillance 
target objects from obtained images. Cited Reference 2 neither 
discloses nor suggests synthesizing a plurality of frames that 
10 constitute a video image to obtain a single image. Therefore, there 
is no disclosure or suggestion regarding the concept of a reference 
frame, which is used during synthesis of frames. 

Further, Cited Reference 1 neither discloses nor suggests 
automatic determination of a reference frame. 
15 Accordingly, the above limitation (iii) will not inevitably 

be conceived of, based on Cited References 1 and 2. 

Due to this difference, manual setting of reference frames and 
ranges of frames to be synthesized are obviated. The invention of 
the present application exhibits the significant advantageous effect 

2 0 that appropriate reference frames and ranges of frames to be 

synthesized can be determined simply and objectively {as described 
in Paragraphs 0006, 0007, and 0024 of the present specification), 
which are not obtainable by Cited Inventions 1 and 2 . 

Accordingly, it is considered that the inventions defined in 
25 Claims 1, 5, 10, 2, 6, and 11 of the present application would not 
have been easily achieved by those skilled in the art, based on the 
inventions disclosed in Cited References 1 and 2. 

Regarding the inventions defined in Claims 3, 4, 7, 8, and 9, 
these claims depend from Claims 1, 2, 5, or 6 . Therefore, it is 

3 0 considered that the inventions defined in these claims would not have 

been easily achieved by those skilled in the art, based on the 
inventions disclosed in Cited References 1 and 2. 



35 



[Conclusion] 

As described above, the invention of the present invention 



would not have been easily achieved by those skilled in the art based 
on the inventions disclosed in Cited References 1 and 2. The 
invention of the present application should be patentable , regardless 
of the existence of the Cited References. 
5 Accordingly, we request a decision in the appeal that cancels 

the original Decision of Rejection and recognizes that the invention 
of the present application is patentable (or a Decision to Grant 
Patent to be issued in pretrial examination) . 
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